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1 Introduction 

In what follows, x = {y; z) = {yi,y';z) stands for a point in = M"* x M""'", n > 3, 

2 < m < n — 1. Denote by V the subspace {x G M" : y = 0}; correspondingly, = {x E 
W : z = 0}. 

Let n be a domain in M". By C^{Q) we denote the set of smooth functions with compact 
support in Q. For 1 < p < oo we denote by Wp{fl) the closure of C^{fl) with respect to the 

o 

norm llVtillp^f^. Obviously, for bounded domains Wp{^l) =wl{^)- 



By definition, for < a < min{l, -} we put p* 



np 

p J - 1 1- a n—ap 

Proposition 1.1 The following inequality 

|(T-1 



\\\yr'v\\p,,n<Arip,cr,Q)-\\Vv\\p,n. (1) 
holds true for any v G Wp (Q) provided 

a) is any domain in for < a < 1 (the region I on Fig. 

b) ncW-\V for p>m, a<min{^^^y/^}, ay^l (li onFtg.m (2) 
^ : c) ncW\{£x M"-™) for p = m, a = (black point on Fig. 

(here i is a ray in beginning at the origin). 

Proof. The case a) is well known; see, e.g., [131 Sec. 2. 1.6]. Note that for cr = 1 we have 
classical Sobolev inequality. 

Consider the cases b) and c). Note that it is sufficient to prove ([1]) for = M" \ P 
(respectively, n = W\{£x M""'")). 

For (7 = one should take conventional Hardy inequality in \ {0} (respectively, in 
M*" \ i; see, e.g., jl6, Sec. 2]) and integrate it with respect to z. 

For m < p < n the inequality ([T]) can be obtained from the cases a = and o" = 1 by the 
Holder inequality. For p > n we also obtain ([T]) by the Holder inequality from the extreme 
cases (7 = and a = the last one corresponds to the Morrey inequality, see [131 Sec. 
1.4.5]. 
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Figure 1: To the Proposition 11.11 

Finally, we deal with the case p = n, < a < 1. Consider the domain f2 = f2i x Q2, 
where i^i = i?2 \ -Bi C M™" is a spherical layer while ^2 =]0, l["~'"c M""™- is a cube. Let us 
write down the embedding theorem W^{fl) ^ Lq{Q), with q = j^. Since the function \y\"' 
is bounded and separated from zero in Q, this theorem can be rewritten as follows: 




Note that all the terms in this inequality are invariant under translations in z and under 
dilations in x. Therefore, the same inequality is valid for VLkt = x {fl2 + t)), with 

A; G Z, t G Z"~™. Summing these inequalities we obtain, subject to g > n, 

n/q 




dxj <C{q,m,n) j ^IV^;]" + da;. 



kt 



The last term is already estimated, and we arrive at ([T]). □ 

Remark 1 The assumption on Vt in the case c) can be considerably weakened. However, it 
is sharp for Q being a wedge. 

We call the Maz'ya— Sobolev inequality. 

We are interested in the attainability of the sharp constant in ([1]), i.e. in the attainability 
of the norm of corresponding embedding operator. If Q is unbounded, or fl P 7^ 0, then 
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this operator is, in general, noncompact; for p < n and a = 1 this is the case for any Q. 
Therefore, the problem of attainability is nontrivial. 

It is well known that the sharp constant in the Sobolev inequality {p < n and a = 1) 
does not depend on Q and is not attained for any Q provided the complement of Q is not 
negligible, i.e. Wp{Q) ^ Wp{W"'). We claim that the same is true ior p < n and < a < 1 
provided r2nP 7^ 0. Indeed, since the inequality ([1]) is dilation invariant, the sharp constant 
in this case cannot depend on Q and equals A/'(p, cr, M"). Further, if the extremal function 
in ([T]) exists, by standard argument (see, for example, the end of the proof of Theorem 12. 2p 
it is (after a suitable normalization) a positive generalized solution of the Dirichlet problem 

-ApU= m fi; u\g^ = (3) 

(here ApU = div(| Vm|^~^Vm) is j9-Laplacian). 

Extending u by zero to M", we obtain an extremal for ([1]) in the whole space. Therefore, 
this extension solves the equation ([3]) in M", and thus it is positive in M", a contradiction. 

By the way, it is worth to note that for p = n the exponent in the denominator of ([3]) 
does not depend on a and equals n. 

The case fl P = 0, dfl fl P 7^ is considerably more complicated. In the recent paper 
[8] the attainability of the sharp constant in ([1]) was proved for p = 2,0<cr<l, under 
rather restrictive assumptions on (a smooth bounded domain) Q. Namely, it is supposed in 
[U Theorem 1.1] that all the main curvatures at any point x° G dQCiV are nonpositive, and 
the mean curvature at any such point does not vanish. 

Our paper consists of two parts. First, we analyze the attainability of the sharp constant 
in ([T]) for Q being a wedge K. = K x R"^"™- (here K is an open cone in W^) or a "perturbed" 
wedge. Here we consider all 1 < p < 00 and < a < min{l, ^}. Naturally, we suppose that 
fl satisfies 

In the second part we prove the attainability of the sharp constant in ([1]) in a bounded 
domain for p = 2 and < a < 1 under considerably weakened requirements on dQ, see 
Section [3] below. Unfortunately, we cannot transfer this result to the case of arbitrary p 
because we do not have in hands good estimates of solutions to the model problem ([3]) in a 
half-space. 

Let us discuss briefly the cases m = 1 and m = n. For m = 1 our problem of interest 
degenerates in a sencqj- Indeed, the only admissible wedge in this case is a half-space 
= {x G M" : yi > 0}. Theorems 12.11 and 12.21 in this case remain valid with the same 
proof while Theorems 12.31 and 12.41 are irrelevant. As for other domains, if C M^, and 
dfl G touches V, then in the neighborhood of a touching point Q in the large scale 
looks like a half-space. Since ([1]) is dilation invariant, we obtain f/{p,a,Q) < Af{p,a,W^). 
The reverse inequality is trivial. As in the case f2 fl P 7^ 0, this implies non-attainability 
of the sharp constant in ([T]) for any Q provided the complement of Q is not negligible in 
R". For p = 2 and bounded domain this fact was proved in [5]. Attainability of the sharp 
constant for m = 1, p = 2 in some unbounded domains without touching of V was discussed 
in 



^Note that Proposition II. II holds true for m = 1 with the only exception: the case c) should be attached 
to the case b). The proof runs without changes. 

^Example 1 after Lemma 2.7 in [33] is not completely correct; it should be 1^ > instead oi ip >0. 
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On the another hand, the problem for m = n, corresponding to the Hardy-Sobolev 
inequahty, was investigated in a number of papers. The existence of the extremal function 
in a cone was proved in [TB] (in the case p = 2, n > 3 this result was established earlier 
in ^). The problem in "perturbed" cone was considered in |T7] (the case p = 2, a = 
was dealt with in |19]). For Q being a compact Riemannian manifold with boundary, the 
conditions of attainability of the sharp constants in ([1]) and in some similar inequalities were 
considered in [2]. The case of bounded domains with G dQ was treated in [3] for p = 2, 
n > 2; similar results under more restrictive assumptions on dfl were obtained earlier in 
rather involved papers [6J for n > 4 and [7j for n = 3. See also the survey [17], where the 
history of related problems and extensive bibliography was given. 

The paper is organized as follows. In Section [2] we collect the results on existence and 
qualitative properties of extremal functions in ([T]) in wedges and in wedges with compact 
perturbation bounded away from V. 

In Section [3] we formulate the assumptions on the behavior of dfl in a neighborhood of 
the origin and prove existence theorems for bounded domains. The technical estimates used 
in this proof are given in Sections HHHl 

Let us introduce the following notation. S"~^ is the sphere in with radius r centered 
at the origin; Un-i = ^^^^ 

We write 0^(1) to show the quantity tending to zero, as £ — )■ 0, with other parameters 
assumed to be fixed. All the other o(l) have the same meaning but are uniform with respect 
to e. 

We recall that a function / :]0,(5[— )■ M is regularly varying (RVF) of order a at the 
origin, if it has a constant sign, and for any t > 

e^O f{e) 

For basic properties of RVFs see [22] . 

We use letter C to denote various positive constants. To indicate that C depends on 
some parameters, we write C{. . .). 

2 The Maz'ya— Sobolev inequality in wedges and in "per- 
turbed" wedges 

Our first statement provides the sharp constants in the Maz'ya inequality in wedges. 

Theorem 2.1 Let 2 < m < n — 1, 1 < p < oo, a = 0. Let K be a cone in R"^. If p > m we 
suppose that K ^ W, and for p = m, zn addition, fsT R*^ \ {0}. Put n = IC = K x R""™ 
and G = K n S™^"*^. Then the sharp constant in ([7]j is not attained and equals {A^p\G))~p , 
where 

CI — 

/ ((^) v^+\v'v\^yds 

Mp\G)= min " (4) 

v&Wl(G)\{0} I \y\PdS 

Jg 

(here V stands for the tangential gradient on S™~^ C MJ^). 
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Proof. First, the minimum in (jl]) is attained due to the compactness of embedding 
Wp{G) Lp(G). Denote by V the minimizer of (HI) normahzed in Lp(G). By standard 
argument, V is positive in G. 

Let us define U{y,z) = U{y) = \y\^~~ ■ ^(]||)- It is shown in \17\ Theorem 18] that U is 
a positive weak solution of the equation 

TJP-I TP~^ 

- A^y^U = A^P\G) inK, and thus, - ApU = A^^^G) m K. (5) 

The relation A^"\G) < Af-P{p, 0, Q) follows now from [20l Theorem 2.3]. For the reader's 
convenience we reproduce the proof based on the so-called generalized Picone identity. 
For any u G C^i^) we set h = G C^i^). Then imphes 

A^p\G) [ dx = A^p\G) [^^hdx= [ \VU\P-^VU ■Vhdx = 

J w J \yr J 

n n 

[plVUr'VU ■ V«U__ _ _ l)|Vf/ry^) dx < (6) 
< y (p|V«|-|Vt/riy^-(p-l)|VC/|^LLj dx< j\Vu\^dx. 



Here (*) is the Cauchy inequality while the last inequality follows from 

prfP-^ + (p _ i)tP > 0, r,t> 0. (7) 

By approximation, (|6]) holds true for u G Wp{Q). 

To prove A^p\G) = A/'^^(p, 0, fi) we consider the sequence us{y,z) = Us{y)Zs{z), where 

fbr^'^'-v^di), \y\<R, fi, 1^1 <i?, 

Usiy)= lR'-f+'{2-\Mi).v{^), R<\y\<2R, Z,(Z) = h - R<\z\<2R, 
[o, \y\>2R] [o, \z\>2R. 

Clearly, us G W^{Q). Direct computation shows 

/I I P 

^rfx- {A^P\G) + 0{6)), 

n 

and the statement follows. 

Finally, the equality sign in (*) means Vu \\ \/U while the equality in ([7]) means r = t. 
These two facts imply 

Vm _ W ^ u-cU 
u U 

on the set {u ^ 0} and, therefore, in the whole f2. Since U ^ WpiVL), the equality in ([6]) is 
impossible. □ 

Next, we consider the Maz'ya-Sobolev inequality in wedges. 
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Theorem 2.2 Let 2 < m < n — 1, l<p<oo,0<a< min{l, ^}. Let K be a cone in MJ^. 

Ifp>m and a < J^E^ we suppose in addition that K ^ . Put n = JC = K x R""™. 

Then the sharp constant in (QP is attained, i.e. there exists a function V G Wp{Q), V" > 
in Q, such that the inequality ([iP becomes equality. 

Proof. It is evident that the sharp constant in ([1]) satisfies the relation 

Af-\p,a,Q)= inf J{v)= inf , J*,^_'^**^;" . (8) 
v&w^{n)\{o} vew^{n)\{o} \\\yr 'v\\p*^n 

Let {vk} be a minimizing sequence for the functional J. Without loss of generality we 
can assume || |?/|'^~"^Wfc||pj,n = 1 and f ^ ^ f in Wp{Q). By the concentration-compactness 
principle of Lions ([H]; see also [5l Ch.l]) we have 

I Vt;fc|P ^m>\Vv\P + Af-P{p, a, Q) ^ af^'^Six - x^), 

jeM 

where the convergence is understood in the sense of measures on the one-point compactifi- 
cation Q U {oo}, a set A4 is at most countable and aj > 0. Moreover, since the embedding 
Pi^p (fi) )■ Lp. is locally compact, we conclude that x^ eV U {oo}. 

Since {vk} is a minimizing sequence, by verbatim repetition of arguments from Theorem 
2.2 [12] we obtain the alternative — either Vk ^ v in Wp{fl) and = (in this case f is a 
minimizer of J), or f = 0, is a singleton and a = 1. 

Let us remark here that, by the dilation invariance of the functional J, we can ensure 

the additional relation f \\y\'^~^Vk\^'^ dx = |, which takes away the second variant. 

nnBi 

It remains to note that the function y = |w| also provides the minimum in the problem 
([8]). Thus, after multiplying by a suitable constant, V becomes a nonnegative generalized 
solution of the Dirichlet problem to the Euler-Lagrange equation ([3]) and thus, it is super- 
p-harmonic in Q. By the Harnack inequality for p-harmonic functions (see, e.g., [21]), it is 
positive in Q. □ 

Now we present some symmetry properties of the extremal function. 

Theorem 2.3 Let the assumptions of Theorem \2.2\ be fulfilled. Then the functon V providing 
the sharp constant in (QP has the following properties: 

1. V is radially symmetric with respect to z, i.e. V = V{y]\z\); 

2. If K is a circular cone, then V is radially symmetric with respect to y' and z, i.e. 

V = V{y^,W\-\z\); 

3. If K = R™ and a > ^(^1^] , then V is radially symmetric with respect to y and z, i.e. 

V = V{\y\;\z\); 

4. Let K = R*" \ {0}. There exists p E]m,n[, and for p > p the function a{m,n,p) 
is defined, such that a < min{l, ^} and for a > a the function V is not radially 
symmetric w.r.t. y. 
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Proof. 1. This statement follows from the properties of the Schwarz symmetrization 
with respect to variables (or from the properties of the Steiner symmetrization with respect 
to Zi for m = n — 1). Indeed, this transformation does not enlarge the numerator in ([H]), 
see, e.g., [ST, Ch.7], and evidently retains the denominator. Thus, it is sufficient to take 
infimum in ([8]) over the set of functions, radially symmetric w.r.t. z. Further, by the Euler 
equation ([3]) all critical points of an extremal radially symmetric w.r.t. z have to be located 
at V. In this case the numerator in ([8]) strictly decreases under symmetrization (see [1]), 
and therefore no function asymmetric w.r.t. z can provide the minimum in (jH]). 

2. In addition to the Part 1, in this case we can apply spherical symmetrization along 
the spheres S^~^, which does not enlarge the numerator, see, e.g., [2T1 App.C], and retains 
the denominator. 

3. Here we can apply the Schwarz symmetrization with respect to variables which does 
not enlarge the numerator, and does not reduce the denominator, see, e.g., [TOl Ch.3]. 

4. In this case the Schwarz symmetrization in ys does not work, and we show that the 
minimizer in general does not inherit the symmetry of extremal problem. 

Let u{\y\; \z\) be a function providing the minimum to the functional J over the set of 
functions in Wp{Q), radially symmetric w.r.t. y and z. Without loss of generality, we assume 
that II = 1- By the principle of symmetric criticality, see [18], dJ^{u; h) = for 

any variation h e Wp{fl). 

Similarly to [151 Theorem 1.3], the second differential of J at the point u can be written 
as follows: 

r-Hu) . .V(.; ^ / |v.r-((p - 2)(v.. v.)^ . ivufW) 



\u 


Pa 




\y 


(1- 





\u 



\y 



(9) 



Now we set h{y; z) = u{\y\; \z\) ■ -pj- . By symmetry of u, J dx = 0. Substituting 

\y\ ^ \y\ 

into ([9]), we obtain 

JP-\u)-d^J(u; h)= ( \Vu\P-^^dx- r(u)-^^^- [ , dx. 

Q n 
Finally, we estimate the first integral by Holder and Hardy inequalities and arrive at 



d^J{u; h) < J{u) 



, 2 2 

p \ pa 



p — mj {m — l){n — pa) 



\{ p > n then the quantity in square brackets is negative for a close to ^. If p < is close 
to ra, this quantity is also negative for a close to 1. In both cases the statement follows. □ 

Corollary. For p > p and a < a < min{l, ^} the problem ([3]) in M" \ P has at least two 
nonequivalent positive solutions. 

Proof. The first solution is a global minimizer of J (under suitable normalization), the 
second one is a minimizer over the set of functions symmetric w.r.t. y. □ 

Further, we consider Q being a perturbed wedge. 



7 



Theorem 2.4 Suppose that 2<m<n — 1, l<j9<oo and < a < min{l, ^}. Let 

ni = IC = K X R"-'" be a wedge satisfying ^, ^2 mW\V and n ^ 0- 

1. For n = Qi\Q2 is not attained. 

2. Let a > 0. Then for fl = fli U Q2 the sharp constant in (QP is attained provided 

3. Let cr = 0. Then, given Q2 (s \ {0}, fig fl 7^ 0, there exists L < 00 such that if 
^2 3 ^'2^ ] — L,L[, fi = fii U ^2 and Wp{^l) ^ W^iVt^) then the sharp constant in (|2]j is 
attained. 

Proof. 1. For any u e C^i^i) there exists a dilation 11 such that Uu G C^(f2). Due to 
the dilation invariance of ([T]) we conclude that Af{p, a, Q) = Af{p, cr, fii). 

Thus, if u minimizes the quotient ([8]) on then its zero continuation minimizes ([8]) 

on Wp{Qi). Therefore, it is the nonnegative solution of the problem in fii. By Harnack's 
inequality for p-harmonic functions, it is positive in fii, a contradiction. 

2. By Theorem 12.21 there exists a function u positive in Qi that minimizes the quotient 
([8]) on Wp{fli). If M{p, (7, Q) = M{p, a, Qi) then the zero continuation of u minimizes ([8]) on 
Wp{fl) that again leads to contradiction. Therefore, A^(p, a, Q) > Af{p, a, Qi). 

Now the statement follows by the concentration-compactness principle. Indeed, let {vk} 
be a minimizing sequence for the functional J. Without loss of generality we can assume 
II |yr~"'^'yfc||pj,n = 1 and f fc ^ f in Wp{Q). As in Theorem 12. 2[ if Vk v then 

Wvl^-Wf^ ^6{x-x), \Vvk\^ ^ Af~P{p,a,n) 6{x - x), 

and X eV U {00}. 

Since Q2 ^ IR" \ similarly to the proof of Corollary 2.1 [i2\, we can assume that 
Vk\^^^ = 0. This implies A/'(p, cr, fi) < cr, a contradiction. 

3. Define Q' = K U Q'2 and Q = Q' x R""'". It is proved in [HI Theorem 20] that 
0, Q') > N'ip, 0, K), and there exists a minimizer U of the quotient ([8]) in Q'. Then U 

is a positive weak solution of the equation 

ApU = X-p{p, 0, n') —— in n. 



Af{p, 0, n) > Af{p, 0, n') > Af{p, 0, K) = Af{p, 0, fii) 

(the last equality is due to Theorem 12.11) . 

Thus, there exists u G C^(fi) such that || |?/|~"^M||p > Af{p,0,Qi) ■ ||Vu||pf^. This 

means A/'(p, 0, fl) > M{p, 0, fii) if L is sufficiently large, and the statement follows by the 

concentration-compactness principle. □ 

In what follows we need some estimates for the solution of the extremal problem (jH]) for 
p = 2 in the half-space. For the sake of brevity, we denote 

2r? 



-AfU = X-^'ip, 0, n') in n', and thus. 

As in Theorem 12.11 this implies 
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By we denote a minimizer of the problem ([8]) for p = 2 in $7 = R". Without loss of 
generality 1. Then 6 is a weak solution of the Dirichlet 

problem 

7,9-1 

-^^ = /^?-^^ H.„=o = 0- (10) 

Proposition 2.1 T/ie function satisfies the following relations: 

0(x)~Ca;„, |V0(a;)|~C, x ^ 0; (11) 

|V0(x)|x^, x^oo. (12) 

Proof. First, we claim that G Cl^'^{M.^). Indeed, the standard elliptic theory, see, e.g., 
[H], provides G Ciq^(]R" \ P). Estimates in the neighborhood of V can be obtained using 
elliptic theory in domains with edges, see, e.g., [H]. Note that the property G Ciof,(M+) 
was proved also in |H1 Appendix]. 

Further, the Hopf lemma gives <Px„\^ _q > 0, and (ITT]) follows. 

Finally, the relations f fT2|) follow from f lTTj) . Indeed, the direct computation shows that 
the image of under the Kelvin transform is also a solution of the problem f lTU]) while f lTT]) 
turns into ([H]). □ 



3 The case of bounded domain 

We assume that in a neighborhood of the set VndQ the boundary is of class C^; outside this 
neighborhood we impose no assumptions on dQ. Suppose there exists a point ^ V (1 dfl 
(without loss of generality, x° = 0) satisfying the properties hsted below. 

Let us introduce local Cartesian coordinates with y' = {1/2, . . . ,ym) in the tangent plane 
and the axis Oyi directed into Q. Then in a neighborhood of the origin dfl is given by 
equation yi = F{y'; z). It is evident that F E and F{y'] z) = o{\y'\ + \z\). Moreover, the 
assumption V (1 Q = ^ implies -F(0; z) > 0. 

We say that dQ is average concave in a neighborhood of the origin (see [3]), if for 
sufficiently small p 

f{p) := jF{y'-z)d^p{y\z)<Q (13) 

(here and later the dashed integral stands for the mean value). 
We introduce also the functions 

/i(r;t):= / / F{y' ■ z) d^r{y')d^t{z), 



gm — 2 gn — m — 1 



/2(p) := j\VF{y'-z)\'d^,{y\z), 



^n — 'Z 



(V stands for the gradient with respect to (?/', z)) and assume that for sufficiently small p 
cos™-2(/3)sin"— i(/3)-|/i(pcos(/3),psin(/3))| <C-|/(p)|, /3g [0,^], (14) 
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and 

lim4^p = 0. (15) 
P^O f{p) 

We say that dQ is average concave in V and directions in a neighborhood of 
the origin, if ( IT3ll holds for sufficiently small p, and 

Now we can formulate the main result of the second part of our paper. 

Theorem 3.1 Let d^l be average concave in V and P-*- directions in a neighborhood of the 
origin, and let the relations [T^ and l[T5\) hold. Suppose also that f is regularly varying of 



order a G [l,n + 1[ at the origin. Then for p = 2 and for any < cr < 1 the infimum in ^ 
is attained. 

Let us compare our assumptions with those of [8j. If dVL is smooth and a = 2, then 
f{p)-'Hp\ f,{r,t)^H^r' + n^^t', f2ip) - Cp' 

near the origin (here "H = 2(~riySp( V'^-F(O)) is the mean curvature of dfl at the origin; 

respectively, = ^Sp(V2,F(0)) and H^" = ^Sp(V2F(0)). 

Since P fl = 0, 'H^'^ is always non-negative. Thus, the relations ( TT3l) and ( |T6l) mean 
that 

< 0; n^^ = 0. (17) 

The relations f lT4|) and f lTSj) are automatically fulfilled in this case. 

One can see that ( flTl) is considerably weaker then the assumptions of [HI Theorem 1.1]. 
We underline also that our hypotheses must be fulfilled at some point x° G P fl dQ while 
the authors of [8] constrain the curvatures at any point x° G "P fl dQ. Moreover, we do not 
require even the existence of the mean curvature (if a < 2). On the other hand, for a > 2 
all curvatures vanish at the origin. 

Remark 2 The assumption l[T5\) can fulfil even if the main term of the asymptotic expansion 
of F vanishes under average. For example, it is the case if F{y'] z) = y2 — y^. 

Remark 3 The assumption is used only to ensure the limit passage under integral sign 
and can be easily weakened. However, it cannot be removed at all, and we prefer to give it 
in a simple form. In turn, the assumption 17^) could be weakened if we had in hands more 
detailed information on the function (p. 

Now consider the limit case a = n + 1. In this case we can drop the assumption ( fT6l) . 

Theorem 3.2 Let dQ be average concave in a neighborhood of the origin, and let the relations 
[14^ and ( 173]) hold. Suppose also that f is regularly varying of order n+ 1 at the origin, and 
Jo ^® dt = —00. Then for p = 2 and for any < a < 1 the infimum in ^ is attained. 
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Proof of Theorems 13.11 and 13.21 Let {v^} be a minimizing sequence for ([8]). 
Without loss of generality we can assume || |y|'^~^ffc||g,Q = 1 and Vk ^ v in W2{fl)- 

Operating as in the proof of Theorem \2.2\ we obtain the alternative — either w is a a 
minimizer of the extremal problem, or f = and 

(the convergence is understood in the sense of measures on Q). 

We claim that in the second case fig{fl) > /i^. Indeed, without loss of generality, Vk 
concentrate near the origin. Further, as in the Corollary 2.1 [12], we can assume supports of 
Vk located in arbitrarily small ball. Since F{y'; z) = o{\y'\ + \z\) and F(0; z) > 0, this implies 

supp(ffe) C /C^ := {x G M" : yi > ->i\y'\} 

for any x > 0. Hence 

flg{Q) > lim fiq{}C^) = flq{}Co) = fig. 

Therefore, to prove the statements we need only to produce a function having the quotient 
([8]) less then fig. Similarly to [3], we construct such function using a suitable dilation and 
"bending" of the function and multiplying it by a cut-off function with small support. 
The sharp estimates of behavior of (p (Proposition 12. ip provide the desired result under 
assumptions on dQ close to optimal. 



Choose 6 such that for \y'\ + \z\ < 2S the relation (fT3!) is satisfied and \F{y'; z)\ < 
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Let us introduce the coordinate transformation 9e : x t-)- e~^{x — F{y'; z) em)- It is 
evident that in a neighborhood of the origin straightens dQ; its Jacobian equals e~"'. 
Also it is easy to see that for r < 5 we have Bjl_ C Q^iBr) C i?2r. 

Let if G C^(M"') be a function, radially symmetric w.r.t. y and z and satisfying < < 1, 

-/ X _ ~/i I I h / 1' if \y\ < f and \z\ < |; 
^ix) = MA^\) = [Q^ if\y\>!or\z\>6 

We introduce the cut-off function (p{x) = ^(9i(a;)). Obviously, the function x i— )■ (p{Qj^{x)) 
is radially symmetric w.r.t. y and z: 

ip{ej^{x)) = (p{eyi + F{ey';ez),ey';ez) = ^{e yi, e y'; ez) = ^{e \y\;e\z\). 

Now we define the function 

0,(x)=£-("-2)/20fe,(a;)) ^(x). 



It is easy to see that (pe GIV 2(^)5 if ^ ^ sufficiently small. 
In Sections HHB] we show that 



n 



dx=l- Me){l + 0,(1) + 0,(1)), (18) 



|V0,(x)p dx = iil + A2{e)il + 0,(1) + 0,(1)) - ^A,ie)il + o,(l)) (19) 
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(we recall that 05(1) is uniform with respect to e). For given S, in these formulas we have, 
as e — )■ 0, 

A,ie)r^C6-'f{e); (20) 

{Ce^^ f{s), under assumptions of Theorem I3.lt 
(21) 
Ce'^' dt, under assumptions of Theorem 13.21 

The relations fl20|) and fl2T|) imply Ai{e) = 0{A2{e)) (in the case a = n + 1 it follows 
from ( 126|) ). Therefore, for sufficiently small 6 and e we have, subject to (fT3i) . 

WV'PeWl + ^2(e)(l + 05(1) + 0,(1)) - ^Ai(£)(l + 0,(1)) _ 



^^"'^ (l-Ai(e)(l + 05(1) + 0,(1))) 

= /i^ + A2{e){l + 05(1) + 0,(1)) < /i^, 

and both Theorems follow. □ 



4 Estimate of the denominator and derivation of (1181) 

We have, using the Taylor expansion. 



r")y\ dx = / , Z , \ nr-^ v'iQj^x)) dydz = 

J \y + £-^Fiey';ez)em\i^^-^^ ^ e \ )) y 

(heree = e(y,^)e]0,l[). 

1. Since is normalized, /i < 1. On the another hand, the first estimate in (fT2ll gives 



2. 



g(l-a) /■ (f)%y;z)yi x ir/ / n j j /. / n 

/2 = J V^{ey; ez) F{ey ; ez) dydz =: Ai[e) 



Proposition 4.1 Given 5, the function Ai{6) satisfies (E^, as e 0. 
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Proof. We claim that 

hm e = q{l - a) UJrn-2^n-m-l X 



J J J (p2 cos2(/3) + S^) 2 



To prove this we apply the Lebesgue theorem. We have 



g(l - a) f{e) f{e 



OO OO OO 



g(l-g)+2 
2 



\ ' yii 

j j F{ey'-ez)dW;^-^{y')dWl-'^-\z)dy^drdt 



gm — 2 gTi — m— 1 



11^ FT^ ^ 






OO 



/~^/ r^:; :t n <t>'^(r, s:t) s ds , , 
(r^ _l_ g2\ 2 
^ ^ 

We can apply the Monotone Convergence Theorem to the interior integral. Further, 
the regular behavior of / implies 

^•^ fi{epcos{(3);epcos{(3)) ^ ^.^ /i(£pcos(/3); £pcos(/3)) _ ^.^ f{ep) ^ ^^g^ a 
s^o f{e) e^o f{ep) e^o f{e) 

Therefore, the assumption on the pointwise convergence is satisfied. Now we produce 
a summable major ant. 

Due to the estimates flTTl) and f[T^ . the interior integral is bounded from above by 

OO 

^ ^ ' 7 l + + + " l + (t2 + r2)^' 

where x^'Kr-t) = X[o,|](r) ■ X[o,f]W- 

Now we pass to the polar coordinates. Using ( |T^ . we estimate the integrand by 



f{ep) p"-^ 



For 7 > we have 
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Since / is RVF of order «, the function /(r) r increases for small r and the function 
/(r) r~("+''') decreases for small r. Therefore, we have 

Since a > 1, the majorant is summable at zero if 7 is sufficiently small. Since a < n+1, 
for small 7 the second exponent does not exceed 



2n — 1 + 7 — q{n — a) = — 1 + 7 



2n(7 
n — 2a 



< -1, 



and the majorant is summable at infinity. 
3. We recall that -F(0; z) > 0, and hence, for small 6 and e 

\y + ^e-^ F{ey';ez)em\ > 

>\y + ^e-' F(0; ez) e^| - e-' \F{ey'; ez) - F(0; ez)\ > 



□ 



> \y\ - \y'\os{l) > M. 



Therefore 

he 



< c 



■ ip^ {ey; ez) rYrT\ — "-y"'^ 



|^|<?(l-a)+2 



^1/(^)1 



F'{ey';ez) f rW.s;z)ds 



e\f{e)\ J {\y'\^ + s^y-"^ 



dy'dz. 



Taking into account (fTTj) and ( IT2|) . we obtain 



(p'^iy' I s] z) ds 



< c 



{\yf + s^)'^ds 



< 



C\y'\ 



1 + {\yf + \z\^ + s2) V - 1 + {\yf + \z\Y- 



and therefore, 



he 



< c 




gn-2 



^1/(^)1 



1 + p5n 



Since qa — 1 > —1, it is easy to see that W^2^(Si ^) is embedded into L2,w(S" ^) with 
weight w = \y'\'^°'^^- Thus, using the Poincare inequality, we can write 



/ \yT-'\ 

nin — 2 



\F{y';z)\'dS'!-'{y',z)< 



< Cp^''-' U ■ j \VF{y'-z)\^d^;-\y\z) + {^j F{y'- z) d^;'\y\ z)^ 
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This implies, subject to (fT5|) . 



he 



< c 



(epf f,{ep) + p(ep) p--^+^- dp 

1 + p9" 



^1/(^)1 



2S 



and we arrive at /a = Ai{e)os{l) . 

We remark also that ^ > n > a — 1. This implies = Ai{e)oi;{l). 

Choosing 6 > sufficiently small and summing the estimates of items 1-3, we arrive at 



5 Estimate of the numerator and derivation of (1191) for 

a < n -\- 1 



We have 



while for i ^ 1 
Hence 

2£-V(a:)0,,(e,(x))((V»(e,(x)),V'F(y';^)> + 



\V(f)eix)\^ dx = 

n a 



1. 



+ 2e--+V(e.(x))y.(x)((V»(e,(x)),VV(x)>- 
- 2£-"+Vy,(0.(^)) 0(0e(a;)) V5(x) (V'F(y'; z), VV(^)> + 



+ e2->2(e,(x)) |VV(x)P + e->^,(e,(x))y.2(x) \VFiy';z)\' + 



+ e--^'ix^l(e,ix))+e'-<p\e^ix))^l(x) + 



2 5-"+V..(e.(x)) ^(x) </)(e,(x)) ^.^(x) 



=: Ji — J2 + ■ ■ ■ + -/g 



^1 + ^7= / ^ {ey;ez)\V(f){y;z)\ dydz = p„ - / (1 - ^ {ey; ez))\V(l){y; z)\ dydz 
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moreover, the second estimate in (fT2|) gives 

oo 

j{l-^{ey-ez))\V(l>{y;z)\^dydz<C j C'-" dC = C 



_6_ 
2e 



whence 

Jl + ^7 = /iJ + C^(5)0(£"). 

2. Integrating by parts we obtain 

J2 = / 2i^'^{ey;ez) (t)y^{y;z) {V(t){y;z),V'F{ey;ez))dydz 



2 



^\ey; ez)^y^ {y; z)A'^{y; z) + {V{^^){ey; ez), V^{y; z))(Py,{y; z) + 

+ ^^{ey; ez){V(j){y; z), V'(j)y, {y; z)) F{ey'; ez) dydz. 

By (fTOl) . we obtain 

2 f ( (\fl~^{y z\\ 

J2 = - y ^{ey\ ez) \d>y^y^ {y- z) + ^i] ^^j^ 1 (t)y, (y, z) F{ey'; ez) dydz- 

'Ij (V'(^^)N; £z), V^iy; z))(Py, (y; z) F{ey'- ez) dydz- 

~-J ^\ey-ez){\V(l){y;z)\^)y,F{ey'-ez) dydz =: H + + K^. 

Now we integrate the first term by parts. 
H = \j ^\ey, ez) [{^^{y, z))y, + ^^|;||^^) F{ey'- ez) dydz = 

^'^{ey; ez)(f)l^{0, y'; z) F{ey'; ez) dy'dz- 
{'^{ey; ez))y^ (p^^ {y; z) F{ey'\ ez) dydz- 



1 

e 

1 



qe 

2{\-o)^\ r .(p''{y]z) yi J-.. , , a f \ < < < 
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Proposition 5.1 . Let assumptions of Theorem \3.1\ hold. Then, given S, the function 
A2{e) satisfies l[21\) . as e — )■ 0. 



Proof. We claim that 

€A2(€) 



lim 



^m.-2^n-m-l X 







/ cos'"-2(/3)sin"-"^-^(/3)<l>(/3)|V0(O,pcos(/3);psin(/3))|2rf/3c/p. (23) 



To prove this we apply the Lebesgue theorem. We have, similarly to Proposition 14. 

oo oo 

^^'^^^ ^ ^^^(er;et)r"-V— ^ ^'^Y/^^^ |V0(O, r; t)p rfrrft. (24) 



a;m-2l^n-m-l 








f{e) 



Passing to the polar coordinates, we see that the integrand converges to that in ( l23l) 
for all p and /3. Now we produce a summable majorant. By ( ITTi) and ( fT2i) . we have 



|V0(O,pcos(/3);psin(/3))| < 



C 



1 + p" 



Therefore for 7 > 0, similarly to Proposition 14. we estimate the integrand by 



n-2 



o— n— 2+7 



Since a < n + 1, this provides a summable majorant for sufficiently small 7. 



□ 



Now we estimate all remaining terms in J2. Since the functions if and (p are radially 
symmetric w.r.t y' and integrating by parts in K2 we have 



K, + K2 + K, = -^ j F{ey'-ez) 



2 (V'(^2)(£2/; ez), V'0(i/; z)></),,(2/; 2;)- 



dydz 



00 00 00 




r'"-V-'"-Vi(er;et)x 



000 



X 



2((v^^Ni,£r;et))^(/)^ + {^'^{eyi,er-et))t(l)t)(l)y^- 
- {^{eyi, er- et))y^ {(pj + cpf) + {^{eyi.er- et))y^ (p: 



dyi drdt. 
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Using the assumption (JH]) and the estimate (fT2|) . we obtain 

C 
J 



+ K2 + K,\<^ II |V0| dy, dp < 



4 II ^--^ // 

In a similar way, 

2 oo oo oo 

7^4 = -^/ / / r-^r— Vi(5r; et) ■ (^^(eyi, er; et))y, "^'^^''""it - dVi drdt, 
Q ^ J J J fr^ I y2\ 2 

\ ' flJ 

and therefore, 



2e - 



p.q{n—c!)—n r r „(jo-_n— 2 I f(Y\\ 



5 J J (r2+52) 



"2" 



(the last relation follows from q{n — o) — 2n = ^^^^ > 0). 

Finally, the integral can be estimated in the same way as I2 in Section HI This 
gives, as e — )■ 0, 

q 

Thus, 

= -A2{e) + C(5)0(£") + '^A^{e){l + o,(l)). 
3. By the estimate (fT2|) . we obtain 

|^3 + ^9|<2£ / 0(?/;z)|V0(i/;z)|^(ei/;£2;)|V^(e?/;e2;)|d?/c/z< 



4. Using the previous estimate, we obviously get 

\J4\<2e [ (l){y;z)\V(l){y;z)\^{ey;ez)\V^isy;ez)\\VF{ey';ez)\dydz< 



<Cs I (p{y]z)\W(p{:y]z)\ip{ey]ez)\Wip{ey;ez)\dydz <C . 
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5. In a similar way, 

\J, + J,\=e' J c^\y-z)\V(p{ey,ez)\^dydz<^ j C,^-- dC = C {^-^\ 



2s 



6. Finally, relations f ll2p and f ll5p imply 

</6 = y {y\ z) ^'^{ey; ez) \VF{ey'- ez)\'^ dydz < 



dyi 





2S_ 25 

J (l + p2)n-l/2^/'- ^ y (l+p2)n-l/2«^^- 


The last integral can be estimated in the same way as in Proposition 15.11 This gives 

Js = 0,(1)^2(5). 

We remark also that = A2{e)oe{l). 

Choosing 5 > sufficiently small and summing the estimates of items 1-6 we obtain (|T9l) . 



6 Derivation of (1191) for a = n+1 

We underline that the assumption a < n + 1 was used in the previous section only in the 
proof of Proposition 15.11 Also the assumption (fT6|) was used only to ensure the positivity of 
the integral in (!23l) . So, we need only to prove the following fact. 

Proposition 6.1 Let assumptions of Theorem {STB hold. Then, given 6, the function A2{e) 
satisfies l[21\). as e —> 0. 

Proof. By ([12]), there exists M > such that 

|V0(O,r;t)| = ^ + p= y;:^Tt2 ^ oo. (25) 

We split the integral ( 12^ into three parts: 



+ // + // ]v\er;et)x 



^ ^„_2^„-,n_i flier- et) ^^^^^^ ^_ t)\^ drdt =: + + L^. 
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The relation (125|) implies that, as i? — )■ oo, 
L2 = {M + OR{l)fx 



5 TT 

2c 2 



X / / cos-^(/3)sin"— ^^^'^^i^?;^^;^"^^^^ ^/^^P 




R 



2e 



<5/2 



(M2 + o^(l))u;„_2 [ fiep) ^ (M2 + OK(l))a;„_2 Z" /(t) 



l^m-2l^n-m-l J S ^ p ^ 
R 



dp 



^m,-2^n-m-\ 



rn+2 



dx. 



Re 



Further, the assumption (HM implies 







fie) 





R 



fi^P) n-2 



fie) 



p"-' dp. 



For given R we can pass to the limit under the integral sign. This provides Li = 
as e — )■ 0. 

On the another hand, divergence of the integral dx implies that for arbitrary large 

we have, as e is sufficiently small. 



.n+l 



5/2 



fie) 



|.n+2 



.n+l 



Ne 



dx > 



Re 



fie) 



rn+2 



dx 



Re 



and thus, Li = o{L2), as £ — )■ 0. 
Finally, as e — )■ 0, 



AT 



fiep) dp 



R 



f{e)p-+^ p 



ln(iV/i?). (1 + 0,(1)), (26) 



\L.\ < C 



— 25 



5/2 



It remains to note that for given R and 6 



5/2 



fM 

rn+2 



dx 



§1^^ + 0(1) 



rn+2 



dx, £ — > 0, 



Re 



and we arrive at 



A2ie) ~ M^un-2e' 



n f /(t) 



rn+2 



dx. 



□ 
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